Your Workspace

You will write all of your implementations within the classroom, using an interface identical to the one shown below. Your Workspace contains five files:

• frozenlake.py - contains the FrozenLakeEnv class
• Dynamic_Programming.ipynb - the mini project notebook where you will write all of your implementations (this is the only file that you will modify!)
• Dynamic_Programming_Solution.ipynb - the instructor solutions corresponding to the mini project notebook
• check_test.py - contains unit tests that you will use to verify that your implementations are correct
• plot_utils.py - contains a plotting function for visualizing state-value functions

The Dynamic_Programming.ipynb notebook can be found below.

Note that it is broken into parts, which are designed to be completed at different parts of the lesson. For instance, you will complete Parts 0 and 1 in the concept titled Mini Project: DP (Parts 0 and 1). Then, you should wait to complete Part 2 until you reach the Mini Project: DP (Part 2) concept. DO NOT COMPLETE THE ENTIRE NOTEBOOK ALL AT ONCE! :)

To peruse the other files, you need only click on "jupyter" in the top left corner to return to the Notebook dashboard.

Please do not write or execute any code just yet. We'll get started with coding within the Workspace in a few concepts!